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FOREWORD 

The  Operations  Research  Center  at  the  Massachusetts  Institute  of 
Technology  Is  an  Interdepartmental  activity  devoted  to  graduate  education 
and  research  In  the  field  of  operations  research.  The  work  of  the  Center 
Is  supported.  In  part,  by  government  contracts  and  grants.  The  work  re- 
ported herein  was  supported  by  the  Office  of  Naval  Research  under  Contract 
N00014-75-C-0556. 


Richard  C.  Larson 
Jeremy  F.  Shapiro 

Co-Dlrectors 


' Abstract 

The  multi-product  production  cycling  problem  Is  concerned  with  the 
determination  of  a production/inventory  policy  for  a single  capacitated 
production  facility  which  Is  dedicated  to  producing  a family  of  products. 
This  paper  studies  this  problem  assuming  stochastic  demand.  The  one- 
product  problem  Is  formulated  as  a Markov  decision  problem  which  may 
be  reasonably  solved.  For  the  multi-product  problem,  heuristic  decision 
rules  are  proposed.  In  the  context  of  an  Identical-product  problem, 
we  develop  a heuristic  decision  policy  which  Is  based  on  the  walysls  of 
the  one-product  problem,  and  on  two  new  notions:  the  composite  product 
and  the  lead-time  adjustment.  This  heuristic  Is  then  extended  to  the 
Identical-cost  problem,  and  the  correlated  demand  problem.  Arguments 
are  presented  for  the  generality  of  the  Identical-cost  problem,  and 
hence  the  generality  of  the  proposed  heuristic  policy. 

\ 


1.  Introduction 


The  multi-product  production  cycling  problem  (MFCP)  Is  concerned  with 
determining  production  and  Inventory  control  policies  for  a group  of  products. 
Each  of  the  products  Is  produced  or  processed  on  a single  facility.  This 
production  facility  or  machine  has  finite  capacity  and  processes  only  one 
product  at  a time.  The  production  for  each  of  the  products  goes  Irto 
Inventory  with  demand  for  the  product  being  serviced  from  this  Inventory. 

The  MPCP  Is  to  devise  a scheduling  policy  for  the  single  production  facility. 
The  criteria  for  the  scheduling  policy  Is  minimum  cost  per  unit  time,  where 
cost  consists  of  setup  costs.  Inventory  holding  costs,  and  backorder  costs. 

Most  of  the  literature  on  the  MPCP  has  been  confined  to  models  which 
assume  deterministic  demand.  Delporte  and  Thomas  [1]  and  Silver  [11]  give 
comprehensive  bibliographies  for  the  MPCP  with  deterministic  and  constant 
demand  rates.  The  work  on  stochastic  demand  problems  has  been  either  very 
preliminary  In  nature  [ 3]  or  hampered  due  to  extremely  restrictive  assump- 
tions [5].  The  deterministic  results  do  not  seem  to  be  particularly  helpful 
In  solving  the  stochastic  problem;  unlike  the  classic  deterministic  Inventory 
theory  which  provides  the  first  step  In  the  development  of  stochastic 
Inventory  theory,  there  has  yet  to  be  demonstrated  a strong  link  between 
the  deterministic  and  stochastic  MPCP.  The  reason  for  this  lack  of  congruence 
seems  to  lie  In  the  complexity  Inherent  In  the  problem:  Any  solution  procedure 
for  the  MPCP  must  tradeoff  lot-sizing  decisions  against  capacity  allocation 
decisions.  For  deterministic  demand,  the  existing  procedures  focus  primarily 
on  lot-slzlng;  the  capacity  allocation  decisions  come  Into  play  only  when 
capacity  constraints  are  violated  which  force  an  adjustment  In  the  lot-slzlng 
decisions  (e.g.  see  [2]).  For  stochastic  demand,  It  Is  not  possible  to 
consider  lot-slzlng  and  capacity  sequentially:  A solution  procedure  which 
focuses  on  lot-slzlng  loses  the  flexibility  needed  to  cope  with  the  capacity 
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allocatlon  decisions  under  unknown  demand.  Similarly,  considering  capacity 
allocation  at  the  expense  of  lot-sizing  will  be  too  rigid  to  handle  fluc- 
tuating demand  and  Inventory  levels.  An  effective  solution  procedure  must 
be  responsive  to  the  limitations  on  scheduling  due  to  finite  capacity,  and 
still  be  able  to  reflect  the  lot-sizing  tradeoffs  among  Inventory  holding 
costs,  backorder  costs  and  setup  costs.  A solution  procedure  must  simul- 
taneously account  for  lot-sizing  and  capacity  allocation. 

The  Intent  of  this  paper  is  to  develop  heuristic  control  policies  for 
the  stochastic  demand  MPCP.  A subsequent  paper  [ 7]  demonstrates  the 
effectiveness  of  these  heuristic  policies.  The  specific  problem  to  be 
considered  is  defined  by  the  following  assumptions: 

1.  Demand  for  each  product  is  stochastic  and  is  specified  by  a known  sta- 
tionary distribution  function. 

2.  The  form  of  the  decision  policy  is  periodic  review. 

3.  At  most  one  product  may  be  produced  in  a period.  Furthermore,  the 
product  must  be  produced  for  the  entire  duration  of  the  period  at  the 
product’s  finite  production  rate. 

4.  Production  in  a period  is  available  for  filling  demand  orders  at  the 
end  of  the  period;  there  is  no  production  lead  time. 

5.  A setup  cost  is  Incurred  whenever  a product  is  produced  unless  that 
product  was  produced  (setup)  in  the  Immediately  preceding  period. 

That  is,  setups  are  carried  over  from  prior  periods.  Whenever  the 
facility  is  shutdown,  any  prior  setup  is  lost  and  is  not  carried  over. 

6.  Setup  times  are  assumed  to  be  zero. 

1 Demand  exceeding  on-hand  Inventory  is  backordered. 

8.  The  objective  is  minimization  of  the  expected  cost  per  unit  time  over 
the  infinite  horizon  over  all  products.  The  con^onents  of  the  total 
coat  are  setup  costs,  inventory  holding  costs,  and  backorder  costs. 
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These  assumptions  may  seem  overly  restrictive,  especially  assumption  4 
(zero  lead  time)  and  6 (zero  setup  time) . However,  these  two  assumptions 
are  made  for  ease  of  exposition  and  may  be  relaxed,  as  will  be  seen. 

The  remainder  of  the  paper  Is  divided  Into  4 sections.  In  the  next 
section  the  one-product  production  cycling  problem  Is  examined.  Based  on 
the  analyses  of  the  one-product  problem.  Section  3 develops  heuristics  for 
a special  form  of  the  MPCP;  the  identical- product  problem.  In  Section  4 
these  heuristics  are  extended  to  a more  general  class  of  MPCP.  Section  5 
gives  a brief  sunnary  and  discussion  of  the  results  of  the  paper. 


I 


P 


-4- 


2.  The  One-Product  Problem 

This  section  considers  a special  case  of  the  MPCP:  the  one-product 
problem.  This  problem  Is  not  a very  realistic  problem.  Our  Interest  In 
this  problem,  however,  stems  from  the  fact  that  some  theoretical  analysis 
of  the  problem  may  be  performed  for  this  version  of  the  MPCP.  Insight 
gained  from  this  analysis  will  form  the  basis  for  the  study  of  the  more 
complex  and  more  realistic  multi-product  problem. 

The  one-product  problem  Is  first  formulated  as  a Markov  decision 
problem.  A discussion  Is  given  for  the  solution  of  this  problem,  and  for 
the  form  of  the  optimal  policy.  It  Is  conjectured  that  the  optimal  policy 
la  a two-crltlcal -number  policy.  In  addition,  we  define  for  the  optimal 
policy  a function  which  may  be  Interpretted  as  a shadow  price  for  the 
machine's  capacity. 

Formulation  of  One-Product  Problem 

Consider  the  one-product  problem.  The  cost  expression  for  this  problem  j 

J 

for  a finite  time  horizon  can  be  defined  by  backward  recursion  as  follows: 

t 

(1)  C(I,k,t)  = min  {G(I)  + E^IC(I-X,  0,  t-1) ] ; 

G(I+P)  + [w(k)]K  + Ej^[C(I+P-A,  1,  t-l)]} 

where 

C(I,k,t)  * expected  cost  for  remaining  t periods  assuming  an  optimal 

decision  policy,  given  inventory  level  I and  machine  status  k. 

C(I,k,t“0)  “ 0 for  all  I,k 

k status  of  facility 

rO  If  facility  is  not  setup  for  production 

k - j 

(.1  If  facility  Is  setup  for  production 

G(I)  “ expected  backorder  and  Inventory  holding  cost  for  current  period, 
given  net  inventory  level  I available  for  servicing  demand. 


r 
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Ej^[C(I-X,k,t) ] “ expectation  of  the  cost  function  taken  over  X, 
the  demand  random  variable. 

= ^ p(l)  C(I-l,k,t)  for  p(l)  = probability  that 

1"0 

demand  (X)  equals  1. 

P « production  rate  measured  In  units  per  period. 

K “ setup  cost 
w(k)  “ Indicator  function 
= 1-k 

Thus,  the  expected  cost  from  following  the  optimal  decision  policy  for  the 
remaining  t periods  Is  the  minimum  of:  (1)  the  expected  cost  If  we  do  not 
produce  In  the  current  period;  (2)  the  expected  cost  If  we  do  produce  In 
the  current  period.  In  each  case,  the  expected  cost  Is  the  expected  back- 
order and  Inventory  holding  cost  for  the  current  period,  plus  a setup 
charge.  If  applicable,  plus  the  expected  cost  for  the  remaining  t-1  periods. 
Note  that  the  machine  status  (k)  In  period  t-1  depends  only  on  the  current 

I 

decision.  Also,  If  the  current  decision  Is  to  produce.  Inventory  Is 
Increased  by  P,and  a setup  charge  Is  Incurred  only  If  the  machine  was 
previously  not  setup. 

This  formulation  may  be  modified  to  model  other  versions  of  the  one- 
product  problem.  It  Is  trivial  to  extend  the  model  If  setups  cannot  be 
carried  over  or  If  the  machine  Is  always  setup.  The  assumption  of  zero 
lead  time  may  be  relaxed  to  allow  for  a lead  time  equal  to  an  Integral 
number  of  periods;  this  extension  Is  analogous  to  that  given  In  [ 9]  for 
a pure  Inventory  model.  The  assumption  of  zero  setup  time  can  also  be 
relaxed  for  a special  case  where  not  only  Is  there  a setup  time  but  also 
a shutdown  time.  The  length  of  the  shutdown  time  must  be  the  same  as 
that  for  the  setup  time.  The  details  of  this  modification  are  given  In  [6  ], 


i 


j 
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To  determine  optimal  policies  for  the  one-product  problem,  one  can  use 
(1)  to  recursively  compute  the  optimal  production  decisions  for  all  values 


of  inventory  I and  remaining  time  t.  Alternatively,  if  the  time  horizon 
for  the  production  process  is  long,  one  is  Interested  in  finding  the 
stationary  steady-state  optimal  policy.  To  do  this,  the  policy  iteration 
method  for  sequential  decision  problems  as  developed  by  Howard  [8]  can  be 
used.  This  method,  however,  requires  a finite  state  space.  The  one- 
product  problem  has  an  infinite  state  space  since  the  inventory  level  can 
range  conceivably  from  to  +“.  To  apply  this  method,  it  is  necessary 

to  truncate  this  infinite  state  space  to  a finite  state  space  by  restricting 
the  inventory  level  to  range  between  some  lower  and  upper  Inventory  levels. 
By  choosing  these  boundaries  intelligently,  the  truncated  problem  will  be 
an  accurate  representation  of  the  original  problem. 

Form  of  Optimal  Policy 

It  is  conjectured  that  the  form  of  the  stationary  steady-state  optimal 
policy  is  a two-crltical-number  policy.  That  is,  a policy  may  be  charac- 
terlzed  by  (I  ,I  ) such  that  once  inventory  drops  below  I , the  facility 

is  turned  on  and  is  kept  on  until  the  Inventory  level  reaches  I 

**  * 

(I  ^ I ) at  which  point  the  facility  is  shut  down.  This  conjecture  is 
very  reasonable  in  the  context  of  Inventory  theory;  indeed  it  is  difficult 
to  fathcm  any  other  policy  form  being  optimal.  Nevertheless,  this  I'.vthor 
has  not  been  able  to  prove  or  disprove  this  conjecture. 

It  is  dlfflc'ilt  to  pinpoint  exactly  why  this  conjecture  has  been  so 
difficult  to  prove  or  disprove.  The  problem  as  formulated  is  more  complex 
than  many  standard  problems  in  the  production/ inventory  literature  in  that 
it  allows  stochastic  demand,  non-zero  setup  cost,  and,  in  particular, 
finite  production  capacity.  The  work  of  Scarf  [10]  in  establishing  the 
optimality  of  (S,8)  policies  for  the  pure  inventory  problem,  and  the  work 
of  Veinott  [13]  in  showing  the  optimality  of  a single-critical-number  policy 


1 
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for  a batch-ordering  problem  without  fixed  ordering  costs,  are  directly 

i 

related  to  the  one-product  problem,  but  have  not  been  useful  in  proving 
the  conjecture. 

Despite  the  absence  of  a conclusive  proof  for  the  conjecture,  there 
is  strong  supporting  evidence  for  its  validity.  When  the  setup  cost  is 
zero  (K“0)  or  when  setups  cannot  be  carried  over,  the  optimal  policy  is 

■k 

characterized  by  a single  critical  number  I . That  is,  if  inventory  is 
less  than  I*,  a decision  to  produce  in  the  current  period  is  made;  other- 
wise there  is  no  production.  A proof  is  given  in  ].  Another  special 

case  that  can  be  analyzed  is  the  one-product  problem  with  positive  setup 
cost  but  where  the  production  quantity  P is  set  to  one  unit  and  the  product 
demand  is  always  an  integer  number  of  units.  It  is  proved  in  [ 6]  that 
the  optimal  policy  for  this  problem  is  a two-critical-number  policy. 

An  additional  indication  of  support  for  the  conjecture  is  given  by 
some  results  on  the  optimal  control  of  a single-server  queue.  Sobel  [12] 
considers  the  continuous  control  of  a single  queue  for  which  there  are 
start-up  and  shut-down  costs  for  turning  on  and  off  the  server,  and  there 
are  general  costs  associated  with  the  queue  length.  This  problem  is  identical 
to  a continuous  review  version  of  the  one-product  problem  where  the  server 
corresponds  to  the  production  facility,  and  the  queue  length  is  the  order 
backlog.  Sobel  shows  that  any  reasonable  policy  will  revert  to  a two- 
crltical-number  policy;  hence,  the  optimal  policy  for  the  continuous  review 
one-product  problem  is  a two-critical-number  policy.  This  is  strong  evidence 
for  the  conjecture’s  validity  since  continuous  review  policies  are  the  limit 
of  periodic  review  policies  as  the  period  lengths  go  to  zero. 

The  Value  Function 

To  gain  insight  into  the  behavior  of  the  optimal  policy  for  the  one- 


product  problem,  it  is  useful  to  define  the  value  function  V(I,t)  as 
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(2)  V(I,t)  = G(I)  - G(I+P)  + E^[C(I-A,0,t-l)]  - Ej^[C(I+P-A,l,t-l)] 

The  optimal  production  policy  is  determined  by  this  function.  If  the 
machine  is  setup  (k=l) , a decision  to  produce  should  be  made  if  and  only 
' if  V(I,t)  is  positive;  alternatively,  if  the  machine  is  not  setup  (k=0) , 

a decision  to  produce  should  be  made  if  and  only  if  V(l,t)  is  greater  than 
K,  the  setup  cost.  Note  that  ^ V(I,t)  is  non-increasing  in  I,  the  optimal 

iff 

policy  is  a two-critical-number  policy  where  [I  (t),I  (t)]  are  defined  by 

V[I*(t)+l,  t)  < K < V[I*(t),t] 

AA  icit 

V[I  (t)-l,t]  > 0 > V[I  (t),t] 

V(I,t)  may  be  interpreted  as  the  value  of  a producing  versus  non- 
producing  production  facility  given  an  inventory  level  of  I and  t periods 
remaining;  that  is,  a rational  product  manager  would  be  willing  to  pay 
as  much  as  V(I,t)  to  turn  on  the  machine  in  the  current  period,  given  that 
in  subsequent  periods  it  will  cost  K to  setup  the  machine.  Hence,  if 
this  value  is  greater  than  the  actual  cost  of  turning  on  the  machine  in  the 
current  period  (K  or  0,  depending  on  the  machine's  status),  then  a decision 
to  produce  is  made. 

For  the  steady-state  problem  we  define  V(I)  to  be  the  limit  of  V(I,t) 

as  t goes  to  Infinity.  V(I)  may  be  readily  computed  from  the  results  of 

the  policy  iteration  method.  If  V(I)  is  non-increasing,  the  optimal  steady- 

* **\ 

State  policy  Is  given  by  (I  ) defined  similar  to  (3}»  (4). 


(3) 

(4) 
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3.  The  Identical-Product  Problem 

The  multi-product  problem  can  be  formulated  similar  to  (1)  as  a set 
of  backward  recursion  equations.  In  theory,  the  multi-product  problem  can 
also  be  solved  by  means  of  the  policy  iteration  method.  However,  the 
computation  required  by  this  method  Increases  exponentially  with  the 
number  of  products,  and  becomes  conq>utatlonally  Infeasible  for  reasonably- 
sized  problems.  Consequently,  we  have  concentrated  on  finding  good 
heuristic  policies  which  are  easy  to  compute  and  Implement.  We  use  the 
Identical-product  problem  to  Illustrate  the  development  of  these  heuristics. 

The  Identical-product  problem  Is  a special  case  of  the  MPCP  in  which 
all  of  the  products  have  identical  demand  distributions,  identical  produc- 
tion rates,  and  identical  cost  structures,  but  with  their  demand  realiza- 
tions being  Independent  across  products. 

A heuristic  solution  for  this  problem  can  be  developed  on  the  basis 

o£  the  one-product  analysis:  Assume  that  each  product  is  the  only  product 

produced  by  the  machine;  then  the  one-product  analysis  may  be  done  to  find 

a decision  policy  for  each  product.  If  we  asuume  the  conjecture  on  the 

form  of  the  optimal  policy  is  true,  then  each  of  the  identical  products 

★ *>• 

Is  governed  by  a tvo-crltlcal-^unber  policy  (X  )•  Each  product’s 
policy  may  be  executed  as  long  as  this  does  not  conflict  with  the  execu- 
tion of  another  product's  policy.  A conflict  will  occur  whenever  more  than 
one  product  wants  to  be  produced  in  a given  period.  For  example,  consider 
the  case  where  the  machine  is  setup  for  product  1,  product  1 has  Inventory 

AA  A 

(Ij^)  less  than  I , and  product  2 has  Inventory  (I2)  less  than  I ; here 
both  products  want  the  machine's  capacity  in  the  immediate  period.  The 
heuristic  must  resolve  the  conflict  in  a reasonable  manner.  One  procedure 
might  be  to  compare  inventory  levels  relative  to  the  respective  critical 
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numbers  (e.g.  produce  the  product  with  the  lower 

relative  Inventory.  Another  procedure  would  be  to  use  the  value  function 
and  produce  that  product  which  values  the  machine  the  highest.  Here 
V(Ij^)  Is  compared  against  V(l2)-K;  note  that  If  the  product  Is  not  setup, 
the  setup  charge  must  be  subtracted  from  the  value  function  to  give  the 
effective  value  of  the  machine. 


The  Composite  Product 

The  procedure  based  on  the  one-product  analysis  Is  reasonable; 
clearly  If  the  one-product  analysis  Indicates  production  for  a product,  then 
In  the  multi-product  problem  with  coiq>etltlon  for  the  available  capacity, 
production  Is  still  desirable.  However,  a weakness  in  this  heuristic  Is 
that  It  does  not  try  to  anticipate  or  plan  for  potential  production  conflicts. 
As  an  example,  consider  a two-product  problem  in  which  the  machine  is  shut- 
down, and  the  Inventory  levels  for  both  products  are  slightly  above  1 . 
One-product  analysis  would  Indicate  no  production  in  the  current  period; 

however.  It  Is  likely  In  the  subsequent  period  that  both  Inventory  levels 

* 

will  fall  below  1 , and  both  products  will  want  to  use  the  production 
facility.  Since  only  one  product  can  be  produced  per  period,  the  inventory 
for  one  of  the  products  will  continue  to  fall.  Incurring  Increasing  coats, 
until  It  Is  able  to  wrest  the  production  facility  away  from  the  other 
product. 

This  problem  could  be  avoided  with  some  foresight  In  the  production 
scheduling  procedure.  By  anticipating  the  potential  competition  for  the 
production  resource  before  It  occurs,  a decision  to  produce  one  of  the 
products  In  the  current  period  could  be  made. 

To  help  anticipate  possible  conflict  situations,  the  notion  of  a 
composite  product  Is  Introduced.  In  the  context  of  the  two-product  example, 
define  the  composite  product  to  have  the  same  cost  parameters  and  the  same 


1 


k 
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productlon  rate  as  either  of  the  products.  Let  the  demand  for  the  composite 

product  be  the  total  demand  for  the  two  separate  products;  that  Is,  the 

demand  distribution  Is  the  convolution  of  the  demand  distributions  for  the 

Individual  products.  This  con^oslte  product  can  now  be  used  to  recognize 

potential  production  conflicts.  The  composite  product  can  be  analyzed  as 

* ** 

if  it  were  one  product  to  find  a production  policy  )•  Now,  with 

the  composite  Inventory,  * decision  whether  or  not  to  "produce" 

the  composite  product  can  be  made  by  conqiarlng  the  composite  Inventory 

* ** 

with  either  or  . A decision  to  "produce"  the  conposlte  product  would 
Indicate  that  the  composite  Inventory  was  not 

adequate  for  the  composite  demand,  realizing  that  the  production  rate  for 
the  composite  product  Is  the  same  as  that  for  either  of  the  Individual 
products.  The  composite  product  shotild  be  helpful  In  anticipating  poten- 
tial conflicts;  when  both  Individual  product  Inventories  are  .just  adequate 
when  considered  separately.  In  composite  the  composite  Inventory  should 
Indicate  the  need  for  current  production. 

The  notion  of  the  composite  product  Is  extendable  to  the  n Identical- 
product  problem.  Here,  n-1  composite  products  are  defined;  composite 
product  j for  j-2,3,...,n  Is  the  product  formed  from  the  composition  of 
J Identical  products.  The  definition  of  each  composite  product  Is 
completely  analogous  to  that  given  In  the  two-product  example;  the  cost 
structure  and  production  rate  for  the  composite  product  are  the  same 
as  the  Individual  products,  while  Its  demand  Is  the  convolution  of  the 

demands  for  J products.  For  each  composite  product,  the  one-product 

* ** 

analysis  can  be  performed  to  find  the  production  policy  ),  where 

the  subscript  J refers  to  the  composite  product  J*>2,3, . . . ,n.  The 
composite  products  can  now  be  Incorporated  Into  the  heuristic  procedure 
to  give  better  detection  and  reaction  to  potential  conflicts  over  the  usage 
of  the  production  facility. 
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The  Lead-Time  Adjustment 

Another  modification  that  can  be  made  is  a lead-time  adjustment.  The 
one-product  analysis  for  the  individual  products  assumes,  by  definition, 
that  the  machine  is  dedicated  to  the  one  product.  Hence,  implicit  in  the 
analysis  is  the  assumption  that  whenever  a production  order  triggers,  the 
machine  is  idle  and  is  able  to  start  production  immediately.  For  the  multi- 
product  problem,  this  is  clearly  not  the  case.  When  a product  triggers, 
there  is  no  guarantee  that  the  machine  is  not  committed  to  another  product. 
Hence,  due  to  the  interaction  of  the  other  products,  there  is  usually  a 
delay  between  the  triggering  and  the  servicing  of  a production  request. 

One  approach  to  account  for  this  delay  is  to  estimate  the  expected  size 
of  the  delay  and  to  treat  it  as  a deterministic  lead  time.  Then  the 
individual  products  may  be  modeled  as  one-product  problems  but  with  a lead 
time  equal  to  the  actual  lead  time  plus  the  expected  delay. 

To  determine  this  lead-time  adjustment,  consider  an  n identical-product 
system  for  which  the  expected  machine  utilization  is  U,  0 < U < 1.  This 
system  is  modeled  as  a birth-death  process  on  the  state  space  {1:1*0, 1, ... ,n} , 
where  state  1*0  corresponds  to  the  machine  being  idle  while  state  1 (1>0) 
is  the  machine  busy  with  1-1  products  having  triggered  and  waiting  for 
production  time.  It  is  assumed  that  products  trigger  randomly  at  an  unknown 
rate  a.  Thus,  the  transition  rate  from  state  1 to  state  1+1  is  * (n-l)a, 
since  at  state  1 there  are  (n-1)  products  that  have  not  triggered.  The 
transition  rate  from  state  1 to  1-1  is  * VJ,  except  for  - 0,  where 
p is  the  service  rate  for  completing  a production  run  for  any  product. 
Assuming  that  the  expected  length  of  a product's  production  run  corresponds 
to  production  of  an  economic  order  quantity  (EOQ) , then 

1 EOQ 

p * P ' 


(5) 
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where  P Is  the  production  rate.  Note  that  this  birth-death  process  Is  an 
approximate  model  of  the  n-product  system.  For  the  birth-death  process  It 
Is  necessary  to  assume  constant  rates  of  transition;  for  the  actual  n-product 
system,  the  transitions  are  governed  by  rates  that  are  not  constant  but 
depend  on  other  system  variables  such  as  current  service  time  and  time 
since  last  production  run.  The  Intent  of  the  birth-death  model  Is  to  have 
a tractable  model  from  which  an  approximate  understanding  of  the  actual 
system  behavior  may  be  obtained. 

The  standard  analysis  (see  Feller  [4])  of  the  equations  of  motion  for 
the  birth-death  process  yields  the  following  equations  for  the  steady- 
state  probabilities  {e^}: 


(6) 


1 n! 

(n-i) ! ®0 


i“0,l,2,...,n 


To  find  e^.  It  Is  necessary  to  know  a,  e^,  and  p.  Since  the  machine  utili- 
zation Is  U,  the  probability  of  the  machine  being  Idle  must  be  1-U;  hence, 

eQ  - 1-U.  The  trigger  rate  a is  found  numerically  from  the  fact  that  the 

n 

probabilities  sum  to  one  ( Z e.  “ 1);  p is  given  In  (5). 

1-0  ^ 

The  expected  delay  can  now  be  expressed  as 
^ n e. 


(7) 


1-1  ®0  ^ 


4-1 


where  (■■^)  Is  the  expected  delay  for  a triggered  product  given  that  there 
are  1-1  products  ahead  of  It. 

* 

The  lead-time  adjustment  L Is  appropriate  for  the  one-product  analysis 
of  the  Individual  products  for  the  n Identical-product  problem.  An  analogous 
lead-time  adjustment  for  the  j-product  composite  product,  j-2,3,...,n,  would 
also  be  desirable.  However,  any  realistic  stochastic  model  to  approximate 
this  adjustment  is  much  more  complex  than  the  birth-death  model  used  for 
the  Individual  products,  and  Is  not  easily  tractable. 
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Stateaent  of  the  Heuristic 

We  can  now  state  a heuristic  for  the  Identical-product  problem.  Incor- 
porating the  one-product  analysis,  the  use  of  composite  products  and  the 
lead-time  adjustment.  For  convenience  In  stating  the  heuristic,  suppose 
the  products  are  arranged  so  that  1 ^ I2  — * * * — ^ j 

Inventory  level  of  product  j.  Let  k denote  the  status  of  the  machine  and 

assume  that  the  optimal  policy  for  the  j -product  composite  product  Is  a 

* **  * 

two-crltlcal-number  policy  )»  J“2,3,...,n.  Let  ) denote 

the  optimal  policy  for  the  Individual  products  where  the  lead  time  has  been 
adjusted  by  the  expected  delay  given  In  (7).  The  heuristic  Is  as  follows: 

1.  Let  j“l;  If  k“0,  go  to  step  6.  If  k**!,  go  to  step  3.  If  k>l,  go  to 
step  2. 

2.  (case  where  j<k)  Set  I,  “ ^ I , I_  » I.  + I,.  If  I < I 

1 1«1  1 ^ 1-1  1 1 ~ j 

A * /V 

and  I2  < Ij  , go  to  step  5.  If  Ij^  > Ij  and  I2  < Ij  , produce  product 
ka  If  1^  ^ Ij  and  ^2  — • produce  product  1.  Otherwise  go  to  step  4. 

A 1 ^ ** 

3a  (case  where  J>k)  Set  I,  * £ I..  If  I,  < I.  , produce  product  k; 

- 1 1-1  ^ J 

otherwise  go  to  step  4. 

4.  If  j-n,  go  to  step  7;  otherwise,  set  j:"J+l.  If  j<k,  go  to  step  2; 

If  J^k,  go  to  step  3. 

5.  Decide  to  produce  either  product  1 or  product  k. 

A i A * 

6.  Set  1,  - i I,.  If  I,  < I.,  produce  product  1.  If  j-n  go  to  step  7. 

1-1  1 1 - J 

Otherwise  set  j:-j+l  and  repeat  this  step. 

7.  Shutdown  the  facility. 

The  heuristic  concentrates  on  possible  production  of  at  most  two  products: 
product  1,  the  product  with  least  Inventory,  and  product  k,  the  product 
currently  setup.  For  each  value  of  j the  procedure  examines  at  most  two 
j-product  composite  products:  the  composite  product  consisting  of  the  j 
products  with  least  Inventories  (composite  product  [j]),  and  the  composite 
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t product  of  the  J-1  products  wl.th  least  Inventories  plus  product  k (conqioslte 

I 

I product  [j-l:k]).  The  heuristic  uses  the  one-product  analysis  for  the 

j-product  composite  product  to  determine  whether  composite  product  [ j ] or 
[J-l:k]  should  be  produced.  Note  that  If  product  k Is  not  one  of  the  j 
least  Inventory  products  or  If  k~0,  then  composite  product  [ j ] Is  not  setup; 
composite  product  [j-l;k]  Is  always  setup.  A decision  to  produce  the 
composite  product  [ j ] and  Incur  a setup  charge,  liiq>lles  production  of 
product  1;  a decision  to  produce  the  composite  product  [J-l:k]  laplles  the 
continuation  of  production  of  product  k.  When  the  facility  Is  currently 
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4.  Extension  to  Non-Identical  Products 

The  previous  section  has  considered  the  Identical-product  problem, 
for  which  a heuristic  procedure  was  developed.  The  current  section  considers 
the  general  multi-product  problem  where  the  products  are  not  Identical. 

A discussion  Is  given  for  the  applicability  of  the  heuristics  proposed  for 
the  Identical-product  problem  to  the  general  MPCP.  It  Is  seen  here  that 
the  heuristics  are  not  easily  extended  to  the  non-ldentlcal-product  problem. 
However,  for  a particular  class  of  non-ldentlcal-product  problems  where 
the  products  have  Identical  cost  structures  but  varying  demand  rates,  the 
composite  product  heuristic  can  be  applied.  Furthermore,  It  Is  argued 
that  these  Identical-cost  problems  are  a very  realistic  class  of  problems 
to  consider. 

The  General  MPCP 

For  the  general  MPCP,  cost  structures,  production  rates,  and  demand 
distributions  may  vary  across  products.  One  heuristic,  similar  to  that 
proposed  for  the  Identical-product  problem,  would  be  to  treat  each  product 
as  If  It  had  a dedicated  machine.  The  one-product  analysis  could  be  done 
for  the  Individual  products,  and  the  heuristic  would  produce  a product  that 
had  triggered  at  the  start  of  a period.  If  more  than  one  product  triggers, 
then  the  heuristic  would  have  to  decide  which  triggered  product  to 
produce,  either  by  comparing  relative  Inventory  levels  or  by  using  the 
products'  value  functions.  As  was  discussed  for  the  Identical -product 
problem,  this  heuristic  Ignores  the  scheduling  dependency  across  products 
and.  Is  unable  to  anticipate  potential  conflicts  for  the  machine's  capacity. 

The  composite  product  heuristic  was  developed  for  the  Identical-product 
problem  to  help  anticipate  production  conflicts.  Vhen  the  products  are 
not  Identical,  the  use  of  coiq>oslte  products  Is  limited  due  to  problems  of 
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defining  and  comparing  the  composite  products.  First,  It  Is  not  clear  how 

! to  define  a composite  product;  when  the  products  have  differing  costs  and 

i 

E 

; production  rates.  It  Is  difficult  to  determine  the  most  appropriate  para- 

meters for  a composite  product.  One  possible  approach  Is  to  use  a weighted 
average  of  the  parameters  for  the  Individual  products,  but  again.  It  Is 
I not  clear  how  to  specify  the  weights  for  the  Individual  products.  Second, 

even  with  a means  for  defining  the  composite  products,  a heuristic  would 

/ 

be  difficult  to  Implement  dtie  to  the  large  number  of  possible  coiq>oslte 

products.  For  n products,  the  number  of  possible  j -product  composite 
f , 

I products  Is  (j).  Not  only  must  the  results  from  the  one-product  analysis 

be  stored  for  each  of  these  composite  products,  but  In  each  decision  period 

t 

I a method  Is  needed  for  searching  over  and  comparing  the  composite  products, 

f When  the  products  are  Identical,  these  problems  are  easier  to  handle 

since  all  J -product  composite  products  are  Identical  and  hence,  only  n-1 
composite  products  need  to  be  defined  (l.e.,  J~2,3,. . . ,n) . Furthermore, 
for  the  Identical-product  problem,  the  decision  procedure  needs  to  consider 
at  most  two  j-product  composite  products:  the  composite  product  with  least 

t 

Inventory  and  the  composite  that  Is  currently  setup  with  least  Inventory. 

The  composite  product  heuristic  may  be  useful  for  the  general  MPCP 
by  limiting  the  number  of  composite  products  that  are  considered.  For 
Instance,  the  decision  procedure.  In  addition  to  the  Individual  one-product 
analysis,  would  only  consider  a composite  product  consisting  of  all 
products  or  only  composite  products  from  the  most  popular  products  (e.g. 

"A"  Items  In  an  "ABC"  breakdown  of  Inventory). 

It  would  be  desirable  for  the  general  MPCP  to  Include  a lead-time 
adjustment  to  the  one-product  analysis  of  the  Individual  products.  Unfor- 
tunately, though,  to  find  this  adjustment  requires  the  analysis  of  a multi- 
dimensional process  which  Is  not  tractable.  Hence,  any  lead-time  adjustment 
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would  have  Co  be  made  empirically  or  by  rule-of-thumb. 

The  Identical-Cost  Problem 

A special  case  of  the  general  MPCP  for  which  the  coiq>oslte-product 
heuristic  is  directly  applicable  is  what  Is  called  the  identical-cost 
problem.  Here,  for  all  products.  Inventory  holding  and  backorder  costs 
are  linear,  and  proportional  to  production  rates;  the  setup  costs  for 
all  products  are  the  same.  That  Is,  for  l>l,2,...,n 

(8)  - h/P^ 

(9)  b^  - b/P^ 

(10)  = K 

where 

h^  • Inventory  holding  cost  per  unit  per  period  for  product  1, 
bj^  “ backorder  cost  per  unit  per  period  for  product  1, 

Pj^  “ production  rate  In  units  per  period  for  product  1, 

• setup  cost  for  product  1, 
h,b,K  > positive  constants. 

The  demand  distributions  may  vary  across  products.  Now,  If  a unit  of  each  j 

product  Is  redefined  so  that  all  products  have  the  same  production  rates  | 

(e.g. , rescale  P^  - 1 for  all  products),  then  the  products  will  have  I 

Identical  cost  parameters.  | 

This  problem  and  its  assumptions  are  very  realistic.  Consider  the 
inventory  holding  and  backorder  costs;  these  costs.  In  general,  are  assumed  to  be 
linear  with  respect  to  the  cost  of  a product.  In  a single  machine  environment  | 

the  cost  of  a product  consists  of  the  cost  of  the  raw  material  as  Input  | 

. 

to  the  processing  facility  plus  the  value  added  to  this  Input  during  the 
processing  function.  Assuming  that  all  products  require  the  same  or 

, _ ^ — i 
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slmllar  raw  materials,  then  It  Is  reasonable  to  suppose  that  the  machine 
processes  the  raw  materials  at  a relatively  steady  dollar  rate.  Independent 
of  product.  Furthermore,  the  rate  of  value  added  by  the  machine  should 
be  approximately  constant  across  products.  If  this  were  not  true,  then 
It  iu>uld  be  argued  that  the  machine  capacity  Is  not  being  used  efficiently. 
Thus,  the  value  of  product  processed  by  the  machine  Is  nearly  constant  over 
time  regardless  of  the  particular  product.  Hence,  after  rescaling  the 
products  to  a comnon  production  rate,  the  products  should  have  similar 
Inventory  holding  and  backorder  costs.  Setup  costs  generally  reflect  the 
labor  cost  for  altering  the  setup  of  the  machine.  I.f  all  products  require 
a similar  amount  of  work  for  their  setups,  then  It  Is  reasonable  to  assume 
they  have  the  same  setup  costs. 

Given  Identical-cost  products,  composite  products  are  easily  defined; 
all  composite  products  have  Inventory  holding  cost  h,  backorder  cost  b, 
setup  cost  K,  and  the  common  production  rate,  while  the  demand  dlstrlbucion 
for  the  composite  product  Is  just  the  convolution  of  the  demand  distribution 
for  the  Individual  products.  However,  since  demand  rates  vary  over  the 
Individual  products,  there  are  still  (j)  j-product  composite  products  to 
consider.  When  all  products  were  Identical,  for  each  J>l,2,...,n  at  most 
two  j-product  composite  products  were  considered.  Similarly,  for  Identical- 
cost  products,  attention  can  be  restricted  to  two  j-product  composite 

products,  for  j“l,2 n.  For  1^^)  the  inventory  status  of  the 

n products,  suppose  that  the  products  are  numbered  so  that 
(If/df)  £ ^^i+l^‘^i+1^  where  d^^  is  the  demand  rate  for  product  1.  That  is, 
the  products  are  arranged  In  Increasing  order  of  Inventory  measured  In 
periods  of  demand  (or  "days  of  supply").  Now,  completely  analogous  to  the 
Identical-product  analysis,  the  two  j-product  composite  products  for  consi- 
deration are  tltc  composite  product  formed  from  products  1 to  j,  and 


i 
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posslbly,  the  composite  product  formed  from  products  1 to  J-1  with  product 
k where  the  machine  Is  currently  setup  for  product  k.  These  two  composite 
products  are  then  con^jared  by  means  of  their  one-product  analysis. 

Thus,  the  notion  of  composite  products,  which  was  developed  for  the 
Identical-product  problem,  can  be  extended  to  the  more  realistic  Identical- 
cost  problem.  Again,  though,  there  Is  no  tractable  model  to  quantify  a 
lead-time  adjustment.  Nevertheless,  In  practice.  It  would  be  desirable 
to  recognize  the  need  for  a lead-time  adjustment  to  reflect  the  scheduling 
dependency  across  products.  This  might  be  done  by  arbitrary  Increases  In 
the  trigger  levels  for  the  products. 


Correlated  Demand 

When  the  demand  across  products  Is  not  Independent  but  Is  correlated, 
the  proposed  heuristics  can  still  be  applied.  Consider  the  Identical- 
product  problem;  for  the  Identical-cost  problem,  the  treatment  Is  analogous 
to  that  given  for  the  Identical-product  problem.  When  demand  Is  correlated, 
the  one-product  analysis  for  the  Individual  products  Is  not  altered;  In 
this  analysis,  there  Is  no  way  to  reflect  the  demand  dependency.  However, 
the  composite  product  heuristic  Is  Ideally  suited  to  account  for  any 
demand  dependency;  the  demand  distribution  for  a conq>o8lte  product  naturally 
Includes  any  correlation  between  the  Individual  products.  For  Instance, 

If  a two-product  composite  product  consists  of  two  Identical  products, 
each  with  normally-distributed  demand  with  mean  |i  and  variance  a^,  and 
If  the  covariance  of  demand  between  the  products  Is  po^,  then  the  coiiq>oslte 
product  has  normally-distributed  demand  with  mean  v>^  ~ Zy  and  variance 
a*  - 2a^(l+p). 
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5.  Discussion  euid  Summary 

In  this  paper  the  MPCP  has  been  defined  and  analyzed.  First,  the 
one-product  problem  was  formulated  as  a Markov  decision  problem,  and 
could  be  solved  In  this  form.  It  was  argued  that  the  multi-product  problem. 
In  general.  Is  too  complex  to  solve  optimally.  Hence,  heuristic  decision 
procedures  were  proposed.  In  particular,  heuristics  were  developed  for 
the  Identical-product  problem;  these  heuristics  were  then  extended  to  the 
non-identical-product  problem,  in  particular  the  identical-cost  problem, 
and  to  the  correlated-demand  problem.  In  the  next  paper  [ 7]  these 
heuristics  are  tested  over  a range  of  sample  problems  by  means  of  simula- 
tion in  order  to  demonstrate  their  effectiveness. 
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